Accelerating Federated Edge Learning via Topology Optimization
نویسندگان
چکیده
Federated edge learning (FEEL) is envisioned as a promising paradigm to achieve privacy-preserving distributed learning. However, it consumes excessive time due the existence of straggler devices. In this article, novel topology-optimized FEEL (TOFEL) scheme proposed tackle heterogeneity issue in federated and improve communication-and-computation efficiency. Specifically, problem jointly optimizing aggregation topology computing speed formulated minimize weighted summation energy consumption latency. To solve mixed-integer nonlinear problem, we propose solution method penalty-based successive convex approximation (SCA), which converges stationary point primal under mild conditions. facilitate real-time decision making, an imitation-learning-based developed, where deep neural networks (DNNs) are trained offline mimic method, imitation DNNs deployed at devices for online inference. Thereby, efficient approach seamlessly integrated into TOFEL framework. Simulation results demonstrate that accelerates process achieves higher Moreover, apply 3-D object detection with multivehicle cloud data sets CARLA simulator. The confirm superior performance over conventional designs same resource deadline constraints.
منابع مشابه
Accelerating Optimization via Adaptive Prediction
We present a powerful general framework for designing data-dependent optimization algorithms, building upon and unifying recent techniques in adaptive regularization, optimistic gradient predictions, and problemdependent randomization. We first present a series of new regret guarantees that hold at any time and under very minimal assumptions, and then show how different relaxations recover exis...
متن کاملPerformance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning
To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is emerging as a promising paradigm by providing computing capabilities within radio access networks in close proximity. Nevertheless, the design of computation offloading policies for a MEC system remains challenging. Specifically, whether to execute an arriving computation task at local mobile dev...
متن کاملAccelerating parallel particle swarm optimization via GPU
This article may be used for research, teaching, and private study purposes. Any substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to anyone is expressly forbidden. The publisher does not give any warranty express or implied or make any representation that the contents will be complete or accurate or up to date...
متن کاملAccelerating Online Convex Optimization via Adaptive Prediction
We present a powerful general framework for designing data-dependent online convex optimization algorithms, building upon and unifying recent techniques in adaptive regularization, optimistic gradient predictions, and problem-dependent randomization. We first present a series of new regret guarantees that hold at any time and under very minimal assumptions, and then show how different relaxatio...
متن کاملAccelerating Training of Deep Neural Networks via Sparse Edge Processing
We propose a reconfigurable hardware architecture for deep neural networks (DNNs) capable of online training and inference, which uses algorithmically pre-determined, structured sparsity to significantly lower memory and computational requirements. This novel architecture introduces the notion of edge-processing to provide flexibility and combines junction pipelining and operational paralleliza...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Internet of Things Journal
سال: 2023
ISSN: ['2372-2541', '2327-4662']
DOI: https://doi.org/10.1109/jiot.2022.3164914